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CLAIMS 



[Claim(s)] 

[Claim 1] The white balance adjustment approach characterized by performing white 
balance adjustment processing of the scene at the time of photoing said image which is 
different to said image according to brightness absolutely in the white balance adjustment 
approach of adjusting the white balance of the image acquired by photography. 
[Claim 2] Said white balance adjustment processing is the white balance adjustment 
approach according to claim 1 characterized by being the processing which makes the 
white point of said image in agreement at the white point of the observation light source 
set up according to said absolute brightness. 

[Claim 3] It is the white balance adjustment approach according to claim 2 characterized 
by shifting and setting the white point of said observation light source to a blue side when 
said absolute brightness is comparatively low. 

[Claim 4] The white balance adjusting device characterized by having the adjustment 
device which performs white balance adjustment processing of the scene at the time of 
photoing said image which is different to said image according to brightness absolutely in 
the white balance adjusting device which adjusts the white balance of the image acquired 
by photography. 

[Claim 5] Said adjustment device is a white balance adjusting device according to claim 4 
characterized by being the means performed as processing which makes the white point of 
said image in agreement at the white point of the observation light source set up in said 
white balance adjustment processing according to said absolute brightness. 
[Claim 6] Said adjustment device is a white balance adjusting device according to claim 5 
characterized by being a means to shift and set the white point of said observation light 
source to a blue side when said absolute brightness is comparatively low. 
[Claim 7] It is the record medium which is characterized by to have the procedure perform 
white balance adjustment processing of the scene at the time of said program photoing said 
image in the record medium which recorded the program for making a computer perform 
the white balance adjustment approach of adjusting the white balance of the image 
acquired by photography, and in which computer read is possible which is different to said 
image according to brightness absolutely and in which computer read is possible. 
[Claim 8] The procedure of performing said white balance adjustment processing is a 
record medium which is characterized by being the procedure of performing processing 
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which makes the white point of said image in agreement at the white point of the 
observation light source set up according to said absolute brightness and in which 
computer read according to claim 7 is possible. 

[Claim 9] It is the record medium which is characterized by having the procedure of 
shifting and setting the white point of said observation light source to a blue side when 
said absolute brightness is comparatively low and in which computer read according to 
claim 8 is possible. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the record medium which recorded the 
program for making the white balance adjustment approach and equipment list which 
adjust the white balance of an image perform the white balance adjustment approach to a 
computer and in which computer read is possible. 
[0002] 

[Description of the Prior Art] In a digital electronic "still" camera (it considers as a digital 
camera below), it can memorize to record media formed in the interior of a digital camera 
by making into digital image data the image acquired by photography, such as an internal 
memory and an IC card, and the image acquired by photography as a soft copy on the 
display as hard copy, such as a print, can be reproduced based on the memorized digital 
image data. Thus, when reproducing the image acquired with the digital camera, having 
the same high-definition image quality as the photograph printed from the negative film is 
expected. 

[0003] bluish, even if it sees white paper under the fluorescent lamp with which chromatic 
adaptation is told to human being's vision, and the daylight differs from it and spectral 
energy distribution on the other hand, and tungsten light - it is - it is - it is said that it is 
reddish - as - it does not perceive but the device fundamentally recognized as white acts. 
Even if the photography light sources differ like the daylight of tungsten light, a 
fluorescent lamp, or the outdoors in consideration of such chromatic adaptation, the digital 
camera which has the function (AWB function) which was made to perform white balance 
adjustment processing (AWB processing) according to the photography light source 
automatically to the image data showing the photoed image is proposed so that the image 
independent of a self-luminous color can be obtained. 
[0004] 

[Problem(s) to be Solved by the Invention] As mentioned above, when performing AWB 
processing in a digital camera, about the image acquired under tungsten light, it adjusts so 
that the balance of the tristimulus values of RGB to tungsten light may become equal. 
However, it is known that the phenomenon of the imperfect adaptation which takes place 
as human being's vision since adaptation is not performed completely will happen, black 
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perfect when it is easy to produce this imperfect adaptation when brightness is low, the 
time when the tint of the light source is strong, and, and seeing a white body especially at 
the part of the shade of day ranges, and twilight after, or night, or not gray but Usu it is 
recognized blue, in order that these may tend to be scattered about and may tend to 
diffract the blue side with short wavelength among sunlight as compared with a red side 
with long wavelength, the light by the side of blue with short wavelength diffracts into the 
part interrupted by the body - reaching - Usu - it looks blue. 

[0005] Therefore, in consideration of imperfect adaptation of human being's vision, the 
thing as the time of photography with the reproduced same image for which the white 
balance of an image is adjusted so that it may be visible and may become the direction is 
desired. 

[0006] This invention is made in view of the above-mentioned situation, and it aims at 
offering the record medium which recorded the program for making the same white 
balance adjustment-approach and same equipment list as the time of photography which 
can adjust the white balance of an image so that it may be visible and may become the 
direction perform the white balance adjustment approach to a computer and in which 
computer read is possible. 
[0007] 

[Means for Solving the Problem] The white balance adjustment approach by this invention 
is characterized by performing white balance adjustment processing of the scene at the 
time of photoing said image which is different to said image, corresponding to brightness 
absolutely in the white balance adjustment approach of adjusting the white balance of the 
image acquired by photography. 

[0008] Here, when image data consists of an RGB code, "a scene is brightness absolutely" 
can change an RGB code into YCC brightness color difference space, it can calculate the 
brightness value Y, and can calculate it based on the frequency distribution of this 
brightness value. Moreover, the brightness of the scene at the time of photography may be 
measured with an illuminometer etc., and this measured brightness may be used as "a 
scene is brightness absolutely." 

[0009] With moreover, "different white balance adjustment processing corresponding to 
brightness absolutely" It is the same thing of processing as the case where it perceives 
when human being looks at the dark scene since the scene is dark when brightness is low 
absolutely which adjusts the white balance of an image so that it may be visible and may 
become the direction. Conversely, since the scene is bright when brightness is high 
absolutely, the same thing of processing as the case where it perceives when human being 
looks at the bright scene which adjusts a white balance so that it may be visible and may 
become the direction is said. 

[0010] In addition, as for said white balance adjustment processing, in the white balance 
adjustment approach by this invention, it is desirable that it is the processing which makes 
the white point of said image in agreement at the white point of the observation light 
source set up according to said absolute brightness. 
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[0011] Here, when image data becomes "making the white point of an image in agreement 
at the white point of the observation light source" from an RGB code, this average is 
changed into CIE 1931 tristimulus values XYZ in quest of the average of an RGB code, and 
it says making these tristimulus values XYZ in agreement with the tristimulus values of 
the white point of the observation light source. 

[0012] Moreover, when said absolute brightness is comparatively low, as for the white 
balance adjustment approach by this invention, it is desirable to shift and set the white 
point of said observation light source to a blue side. 

[0013] The white balance adjusting device by this invention is characterized by having the 
adjustment device which performs white balance adjustment processing of the scene at the 
time of photoing said image which is different to said image according to brightness 
absolutely in the white balance adjusting device which adjusts the white balance of the 
image acquired by photography. 

[0014] In addition, as for said adjustment device, in the white balance adjusting device by 
this invention, it is desirable that it is the means performed as processing which makes the 
white point of said image in agreement at the white point of the observation light source 
set up in said white balance adjustment processing according to said absolute brightness. 
[0015] Moreover, when said absolute brightness of said adjustment device is comparatively 
low, as for the white balance adjusting device by this invention, it is desirable that it is a 
means to shift and set the white point of said observation light source to a blue side. 
[0016] In addition, the white balance adjustment approach by this invention may be 
recorded on the record medium in which computer read is possible as a program for 
performing a computer, and may be offered. 
[0017] 

[Effect of the Invention] Since the scene is dark when brightness is low absolutely in order 
to perform white balance adjustment processing of the scene at the time of photoing an 
image which is different to an image, corresponding to brightness absolutely according to 
this invention, the same image as the time of photography which appears and becomes the 
direction can obtain by [ the / as the case where it perceives when human being looks at the 
dark scene / same ] performing white balance adjustment processing so that it may be 
visible and may become the direction. Conversely, since the scene is bright when 
brightness is high absolutely, the same image as the case where it perceives when human 
being looks at the bright scene which appears and becomes the direction can be obtained. 
[0018] moreover, the case where human being perceives about the shady part and the 
scene of night which are interrupted by the object by shifting and setting the white point to 
a blue side when it is the processing which makes the white point of an image in 
agreement at the white point of the observation light source when white balance 
adjustment processing was absolutely set up according to brightness, and brightness is 
comparatively low absolutely - the same - Usu - the blue image which appears and 
becomes the direction can obtain. 
[0019] 
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[Embodiment of the Invention] With reference to a drawing, the operation gestalt of this 
invention is explained below. 

[0020] Drawing 1 is the outline block diagram showing the configuration of the white 
balance adjusting device by the 1st operation gestalt of this invention. As shown in 
drawing 1 , the white balance adjusting device by this operation gestalt comes to have an 
AWB means 2 to perform white balance adjustment processing to the image data SO 
acquired by photoing a scene in a digital camera 1, and to obtain the processed image data 
SI. In addition, image data SO shall consist of a signal value with a color [ based on ITU 
Rec.709 specification / RGB each ] of 8 bits, and explains each signal value as R0, GO, and 
B0. 

[0021] In addition, the white balance adjusting device by this operation gestalt may be 
formed in the image pick-up equipment which reads an image in a digital camera 1 or a 
film, and may be formed in regenerative apparatus which reproduce the image data 
obtained in these image pick-up equipments, such as a monitor and a printer. Moreover, 
you may use as a white balance adjusting-device simple substance. 

[0022] In the AWB means 2, as it is the following, white balance adjustment processing is 
performed to image data SO. First, each signal value R0 is changed into the signal value Rl 
normalized by the following formula (l) and (2) at the value of 0*1. 
[0023] 

[Equation l] 

[0024] In addition, it asks by the operation same also about the signal values Gl and Bl as 
the signal value Rl. 

[0025] Subsequently, the averages R2 and G2 of the signal values Rl, Gl, and Bl and B-2 
are computed by the following formula (3) using all the several Ns pixels of the image 
expressed by image data SO. 
[0026] 

[Equation 2] 

[0027] And the averages R2 and G2 and B-2 which were computed are changed into 
CIE1931XYZ tristimulus values by the following formula (4), and let this be the 
tristimulus values Xw, Yw, and Zw of the white point in the image expressed by image 
data SO. 
[0028] 

[Equation 3] 

[0029] Moreover, it changes into tristimulus values XI, Yl, and Zl by the formula (5) also 
about the signal values Rl, Gl, and Bl. 
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[0030] 

[Equation 4] 

[0031] On the other hand, the signal values R0, GO, and B0 are changed into the 

brightness value Y by the following formula (6). 

[0032] 

Y=0.299R0+0.587G0+0.114B0 (6) 

And the histogram of the brightness value Y which took the brightness value along the 
axis of abscissa, and took frequency along the axis of ordinate as shown in drawing 2 is 
created. And in this histogram, when distribution of the brightness value Y is searched for 
and that distribution inclines toward the low brightness side, it judges with it being the 
scene photoed in the place where that image is dark. For example, as shown in the 
histogram HI of drawing 2 , when the brightness value YM which sees from the low 
brightness side of a histogram HI, and serves as 98% of frequency distribution is smaller 
than a threshold Th 1 (it is 64 by the case where it is 8 bits), it judges with image data SO 
being a thing showing the image obtained by photoing a dark scene. Moreover, when the 
brightness values YM are one or more thresholds Th, it judges with it being the usual 
image. 

[0033] And when judged with it being the usual image, a white balance is adjusted so that 
the tristimulus values Xw, Yw, and Zw computed by the above-mentioned formula (4) may 
be in agreement with the tristimulus values Xs, Ys, and Zs of the white point in the 
observation light source of an output media (for example, it considers as a print). On the 
other hand, when judged with it being the image of a dark scene, a white balance is 
adjusted so that it may be in agreement with the tristimulus values Xb, Yb, and Zb of the 
white point when the tristimulus values Xw, Yw, and Zw computed by the formula (4) 
shifted the white point in the observation light source of an output media to the blue side. 
Hereafter, the detail of this white balance adjustment processing is explained. In addition, 
this white balance adjustment processing follows the chromatic adaptation prediction type 
of von Kries. Moreover, the observation light source of an output media is made into 
CIE-D50 (white point; Xs=96.42, Ys=100.0, Zs=82.49) here. 

[0034] First, when judged with the usual image, the tristimulus values Xw, Yw, and Zw of 
the white point are changed into the tristimulus values Lw, Mw, and Sw based on 
physiology primary color by the following formula (7). Moreover, the tristimulus values of 
the white point in the observation light source of an output media are changed into the 
tristimulus values based on physiology primary color by the formula (8). 
[0035] 

[Equation 5] 

[0036] And the tristimulus values XI, Yl, and Zl of each pixel computed by the 
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above-mentioned formula (5) are changed into tristimulus values X4, Y4, and Z4 by the 
following formula (9). Subsequently, these tristimulus values X4, Y4, and Z4 are changed 
into the signal values R4 and G4 and B4 by the following formula (10), and the signal 
values R5 and G5 and B5 are obtained by solving a formula (l) and (2) conversely further, 
and let this be the processed image data SI by which white balance adjustment processing 
was made. 
[0037] 

[Equation 6] 
[0038] 

[Equation 7] 

[0039] On the other hand, when judged with it being the image of a dark scene, the white 
point (Xs=96.42, Ys=100.0, Zs=82.49) in the observation light source of an output media is 
shifted to a blue side, and it considers as the tristimulus values Xb, Yb, and Zb (Xb=95.04, 
Yb=100.0, Xb=108.89) of the white point. And the tristimulus values Xw, Yw, and Zw of the 
white point are changed into the tristimulus values Lw, Mw, and Sw based on physiology 
primary color by the above-mentioned formula (7), and the tristimulus values of the white 
point shifted to the blue side by the following formula (ll) are changed into the tristimulus 
values based on physiology primary color. 
[0040] 

[Equation 8] 

[0041] Arid the tristimulus values XI, Yl, and Zl of each pixel computed by the 
above-mentioned formula (5) are changed into tristimulus values X6, Y6, and Z6 by the 
following formula (12). Subsequently, these tristimulus values X6, Y6, and Z6 are changed 
into the signal values R6 and G6 and B6 by the following formula (13), and the signal 
values R7, G7, and B7 are acquired by solving a formula (l) and (2) conversely further, and 
let this be the processed image data Si by which white balance adjustment processing was 
made. 
[0042] 

[Equation 9] 
[0043] 

[Equation 10] 
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[0044] Subsequently, actuation of this operation gestalt is explained. Drawing 3 is a flow 
chart which shows actuation of this operation gestalt. First, the signal values Rl, Gl, and 
Bl are computed by the operation of a formula (l) and (2) to the signal values R0, GO, and 
B0 which constitute the image data SO obtained in the digital camera 1 (step Si). 
Subsequently, the averages R2 and G2 of the signal values Rl, Gl, and Bl and B"2 are 
computed by the formula (3) (step S2), and the tristimulus values Xw, Yw, and Zw of the 
white point are computed by the formula (4) using the averages R2 and G2 and B-2 (step 
S3). Moreover, tristimulus values XI, Yl, and Zl are computed from the signal values Rl, 
Gl, and B l by the formula (5) with this (step S4). in addition, processing of step S4 - step S 
- you may carry out ahead of 2 and 3 and may carry out by standing in a row with this. 
[0045] Furthermore, it is judged whether the brightness value YM which changes the 
signal values R0, GO, and B0 into the brightness value Y by the formula (6) (step S5), 
creates the histogram of the brightness value Y further (step S6), sees from the low 
brightness side of distribution of a brightness value in this histogram, and serves as 98% of 
frequency distribution is smaller than a threshold Th 1 (step S7X and when step S7 is 
denied So that the tristimulus values Xw, Yw, and Zw of the white point computed by the 
above-mentioned formula (4) may be in agreement with the tristimulus values Xs, Ys, and 
Zs of the white point in the observation light source of an output media Tristimulus values 
XI, Yl, and Zl are changed into tristimulus values X4, Y4, and Z4 from a formula (7) by (9) 
(step S8). While changing this into the signal values R4, G4, and G4 by the formula (10) 
(step S9), the signal values R5 and G5 and B5 are computed by solving a formula (l) and 
(2) conversely (step Si 0), and processing is ended by making this into the processed image 
data SI. 

[0046] On the other hand, when step S7 is affirmed, shift the white point in the 
observation light source of an output media to a blue side, and it considers as the 
tristimulus values Xb, Yb, and Zb of the white point. So that the tristimulus values Xw, Yw, 
and Zw of the white point computed by the formula (4) may be in agreement with 
tristimulus values Xb, Yb, and Zb Tristimulus values XI, Yl, and Zl are changed into 
tristimulus values X6, Y6, and Z6 by the formula (7), (11), and (12) (step Sll). While 
changing this into the signal values R6, G6, and G6 by the formula (13) (step S12), the 
signal values R7, G7, and B7 are computed by solving a formula (1) and (2) conversely (step 
S13), and processing is ended by making this into the processed image data SI. 
[0047] Thus, when distribution of the brightness value Y inclines toward the low 
brightness side, in order according to this operation gestalt for the scene at the time of 
photography to shift the white point of the observation light source to a blue side and to 
adjust a white balance as a dark thing, the case where human being perceives the shady 
part and the scene of night which are interrupted by the object in the image obtained by 
reproducing image data SI - the same - Usu blue - it is visible and can become the 
direction. 

[0048] Subsequently, the 2nd operation gestalt of this invention is explained. In addition, 
since the configuration of the white balance adjusting device in the 2nd operation gestalt is 
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the same as the configuration of the white balance adjusting device shown in drawing 1 , 
detailed explanation is omitted. In the 2nd operation gestalt, the methods of a setup of the 
white point of the 1st operation gestalt and the observation light source differ. Hereafter, 
the processing performed in the white balance adjusting device by the 2nd operation 
gestalt is explained. 

[0049] In the 2nd operation gestalt, the tristimulus values Xw, Yw, and Zw of the white 
point, the tristimulus values XI, Yl, and Zl in each pixel, and the brightness value Y are 
first computed by the formula (6) from the formula (l) in the operation gestalt of the above 
1st. And the histogram of the brightness value Y is created, the brightness value YM and 
thresholds Th2 and Th3 which see from the low brightness side of this histogram, and 
serve as 98% of frequency distribution are compared, the brightness of the image expressed 
by image data SO according to this comparison result is classified, and the white point of 
the observation light source is set up based on this classification result. 
[0050] A threshold Th 2 is set to 64, a threshold Th 1 is set to 32, and, specifically, 
brightness of an image is classified into three kinds, 0-31, 32-63, and 64*255, as a value of 
the brightness value YM (it considers as Classifications A, B, and C below, respectively). 
And according to the classification of the brightness of an image, the tristimulus values Xs, 
Ys, and Zs of the white point in the observation light source of an output media are 
changed into a blue side, namely, when classified into A (YM<Thl) Tristimulus values Xs, 
Ys, and Zs are made into the same tristimulus values Xb, Yb, and Zb (Xb=95.04, Yb=100.0, 
Xb=108.89) as CIED50 in the operation gestalt of the above 1st. When classified into C 
(YM>=Th2), let tristimulus values Xs, Ys, and Zs be the tristimulus values (Xs=96.42, 
Ys=100.0, Zs=82.49) in the operation gestalt of the above 1st, and the same value. And 
when classified into B (Thl <=YM<Th2), tristimulus values Xs, Ys, and Zs are computed 
by [ as it is shown in the following formula (14) based on the tristimulus values at the time 
of being classified into A and C], 
[0051] 

[Equation 11] 

[0052] By this, the white point in the observation light source of an output media will shift 
to a blue side, so that an image is dark, as shown in drawing 4 . 

[0053] And using the tristimulus values Xs, Ys, and Zs set up according to the brightness of 
an image in this way, as shown in a formula (7) and the following formula (15), and (16) 
Tristimulus values XI, Yl, and Zl are changed into tristimulus values X9, Y9, and Z9, and 
the signal values R7, G7, and B7 are acquired by solving a formula (l) and (2) conversely 
further, and let this be the processed image data SI by which white balance adjustment 
processing was made. . 
[0054] 

[Equation 12] 
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[0055] Thus, in order to classify the brightness of an image according to the brightness 
value YM, to respond in the 2nd operation gestalt according to this classification result, to 
shift the white point in the observation light source of an output media to a blue side and to 
perform white balance adjustment processing, the case where human being perceives the 
shady part and the scene of night which are interrupted by the object in the image 
obtained by reproducing image data Si ■■■ the same - the brightness of an actual scene - 
responding - Usu — blue - it is visible and can become the direction. 

[0056] In addition, although it is asking for the brightness of a scene based on image data 
SO in the above 1st and the 2nd operation gestalt, an illuminometer is formed in image 
pick-up means, such as a digital camera which acquires image data SO, and the 
illuminance value detected by this illuminometer is inputted into the white balance 
adjusting device by this operation gestalt with image data SO, and when a scene is photoed, 
you may consider absolutely that this illuminance value is brightness. In this case, 
according to an illuminance value, the white point of the observation light source may be 
shifted to a blue side, adjustment processing of a white balance may be performed like the 
operation gestalt of the above 1st, and white balance adjustment processing may be 
performed like the operation gestalt of the above 2nd as what is different according to an 
illuminance value in the amount of gaps by the side of the blue of the white point of the 
observation light source. 

[0057] In addition, in the above-mentioned operation gestalt, although white balance 
adjustment processing is performed to the image data SO obtained in the digital camera 1, 
white balance adjustment processing can be performed like the above also to the image 
data SO obtained by reading the image recorded on the film. 
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[Brief Description of the Drawings] 

[Drawing l] The outline block diagram showing the configuration of the white balance 

adjusting device by the operation gestalt of this invention 

[Drawing 2] Drawing showing the histogram of a brightness value 

[Drawing 3] The flow chart which shows actuation of this operation gestalt 

[Drawing 4] Drawing for explaining a setup of the white point of the observation light 

source in the 2nd operation gestalt 

[Description of Notations] 

1 Digital Camera 

2AWBMeans 
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